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STRUCTURES TO REPRESENT POORLY FORMED HTML DOCUMENTS 

Copyright Notice 

This patent specification contains material that is subject to copyright protection. 
The copyright owner has no objection to the reproduction of this patent specification or 
related materials from associated patent office files for the purposes of review, but 
otherwise reserves all copyright whatsoever. 

Technical Field of the Invention 

The present invention relates to structuring within electronic documents and, in 
particular, to structuring forms within computer languages such as mark-up languages and 
documents formed therefrom. 

Background Art 

The field of computer coding covers many different coding and program 
schemes all of which incorporate certain rules that define the particular coding schen^e 
and which generally must be adhered to by uses of such schemes in order for results tq|be 
derived therefrom. For example, a person programming in the language Pascal must 
ensure their code corresponds the appropriate Pascal syntax in order for the Pascal 
program to operate. Where code does not comply, a "syntax error" will occur upon 
compilation of the program. ^ 

As opposed to programming in a highly structured language, more recently it has 
become common to alter or create documents using so called "mark-up languages" to 
provide a mechanism by which content in a document is presented in a particular 
environment, usually upon a display screen or printing device. One example of this is the 
Hypertext Mark-up Language (HTML) and another is the Extended Mark-up Language 
(XML). The purpose of such mark-up languages is to provide additional notation to 
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content desired to be displayed or presented, so as to causes the content to be displayed or 
presented in fashion desired by the author. 

The HTML document format pervades the Internet and the World Wide Web. In 
practice, documents structured with HTML mark-up are often in error in that they do not 

5 comply the particular internationally recognised HTML standard operating at the time of 
document creation. The current HTLM standard at the time of drafting this patent 
specification may be found at http://www.w3c.org and http ://www.w3c.org /TR/REC-htm 1 40/. 

The current standard for HTML documents insists that such documents be 
expressed as trees. Such a structure requires that each element of the document must be 

10 wholly contained by another element and, as a consequence, elements may not overlap. 
The experience of many indicates that it is easy to produce a document that superficially 
looks like HTML, but which in fact violates the tree- like hierarchical structures 
established by the HTML standard. Further, whilst human interpretation of su^ 
erroneous documents can often resolve ambiguities, there is often a mismatch betv^en 

15 what makes sense according to the current standard and that which the author of the 
HTML document actually intends. 

Computer applications which read HTML approach such problems in a number 
of different ways. Some applications reject the bad HTML structure, thereby omitting the 
content or rendering the content in non-intuitive ways. Examples of these include 

20 "OPERA" and a number of smaller distribution Internet browsers which are preferred by 
some users for much more strict behaviours. Other applications try to match the user's 
likely intention despite of the strict errors contained in the HTML source. Examples of 
these include "Internet Explorer" (trade mark) manufactured by Microsoft Corporation, 
"Netscape Navigator" (trade mark) manufactured by Netscape Corporation, and 

25 "WebRecord" (trade mark) marketed by Canon Inc. In spite of the reasonable efforts the 
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present inventors to determine how Internet Explorer and Netscape Navigator handle 
variations away from strict HTML, the present inventors have not been able to determine 
how those products perform in a manner so as to apparently resolve ambiguous or 
erroneous HTML. 

5 A significant problem that arises from such in compliance with the HTML 

standard is that there exist other languages and tools which interact with HTML 
documents, for example scripting language like JAVA script and styling languages like 
CSS2 (Cascading Style Sheet 2), Such tools expect that there is a strict tree structure in 
an HTML document and, as a consequence, often have no defined behaviour when 
10 interpreting a poorly formed HTML document. As a consequence an authored result 
cannot be guaranteed. 

Disclosure of the Invention 

It is an object of the present invention to substantially overcome, or at lea^t 
ameliorate, one or more disadvantages of existing arrangements. i 
15 According to a first aspect of the invention, there is provided a method of 

restructuring an input HTML document to comply with strict HTML, said method 
comprising the steps of: 

(a) linearly traversing said input HTML document to create a hierarchical 
tree structure representation, said traversal maintaining a current insertion point for 

20 elements within said tree structure representation; 

(b) during said traversal, identifying those elements of said input HTML 
document that violate strict HTML and, for each said identified element: 

(b)(i) retracing said tree structure representation from said current 
insertion point to identify an further insertion point from which said identified 
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element can depend, said retracing comprising noting each parent element of said 
identified element passed during said retracing; 

(b)(ii) at said further insertion point, creating new elements in said 
tree structure representation corresponding to those said parent elements passed 
during said retracing, said new elements being created in reverse chronological 
order to that encountered during said retracing; and 

(b)(iii) appending said identified element to a terminal one of said new 
elements; and 

(c) converting said tree structure representation into an output HTML 
document. 

According to another aspect of the invention, there is provided an apparatus for 
implementing any one of the aforementioned methods. According to another aspect of 
the invention there is provided a computer program product including a computer 
readable medium having recorded thereon a computer program for implementing any|)ne 
of the methods described above. Other aspects of the invention are also disclosed. 

Brief Description of the Drawings 

A number of preferred embodiments of the present invention will now be 
described with reference to the drawings, in which: ^ 

Fig. 1 depicts the tree structure of an HTML document; 

Figs. 2A to 2F depict various processing stages according to an embodiment of 
the present invention; and 

Fig. 3 is a schematic block diagram of a general purpose computer upon which 
the preferred embodiment of the present invention can be practiced. 

Detailed Description including Best Mode 
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The principles of the preferred embodiment described herein have general 
applicability to computer network browsing applications. However, for ease of 
explanation, of the preferred embodiment is described with reference to HTML and to 
browsers that operate on the World Wide Web (WWW) and standards applicable thereto. 
5 However, it is not intended that the present invention be limited to the described method. 
For example, the invention may have application in other standards environments, such as 
error correction and data recovery for XML applications. 

Prior to describing the preferred embodiment, it is appropriate to review 
particular standards issues addressed thereby. For instance, elements in HTML have a 
10 starting tag and an ending tag. For example, with a strict HTML syntax, a document 
having two paragraphs of bold text may be represented in the following fashion indicated 
by Code A below. 

Code A f 
<BODY> If 
15 <P><B>The first paragraph, </B></P> 

<P><B>The second paragraph. </B></P> 
</BODY> 

Code A commences with an identifier as to the body of the particular element of 

# 

code which is then followed by this first sub-tag P indicating the commencement of a 
20 paragraph. That tag is followed by a sub-tag B which effectively "switches on" a bold 
function for the following elements. Code A then recites the text content of the first 
paragraph of the document, which is concluded by a switch which turns off the bold, and 
a further switch which terminates the paragraph. The second paragraph is also 
commenced using a paragraph opening tag followed by a corresponding bold switch-on 
25 tag. The text of the second paragraph follows, then a bold switch-off tag and a paragraph 
terminator. The body is then terminated in an appropriate fashion. 
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Whilst Code A depicts strict HTML, the HTML standard permits some shortcuts 
or abbreviations. Code A may be abbreviated in the fashion represented below by 
Code B below. 

Code B 
5 <BODY> 

<P><B>The first paragraph, </B> 
<P><B>The second paragraph, </B> 
</BODY> 

It will be seen from Code B that each of the paragraph terminating tags has been 
10 omitted from the code. This is permitted by HTML because, in the case of the first 
paragraph, this is followed by paragraph opening tag. Since HTML does not permit the 
nesting of paragraphs, the standard readily resolves the opening of the new paragraph as 
requiring that the previous paragraph has closed. The same occurs with the body 
terminator. 

15 A common error in HTML drafting is to omit some of the necessary tags 

required by strict interpretation. An example of this is seen in Code C where the bold 
turn-off tag in the first paragraph and the bold tags in the second paragraph have been 
omitted. Such an anomaly occurs because many authors consider such syntax mean that 
the bold extends into the second paragraph. 

20 Code C 

<BODY> 

<P><B>The first paragraph. 
<P>The second paragraph. 
</BODY> 

25 The situation presented in Code C above leads to the impossible situation of one 

element (in this case, the bold) somehow sharing two parents. In this case, the bold 
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element is started in the first paragraph and finished in the second paragraph. This 
interpretation has both paragraph elements as parents to the bold element. 

Because a paragraph in HTML cannot be nested inside another paragraph, the 
beginning of a new paragraph terminates the previous paragraph and, consequently, must 
terminate any elements that are children of the first paragraph. 

There is another way this same type of error can occur in HTML documents, this 
being depicted in Code D below. 

CodeD 

<BODY> 

<P><B>The first paragraph. </P> 
<P>The second paragraph. 
</BODY> 

In the case of Code D, the closing of the first paragraph is explicit but there stfll 
exists the ambiguous termination of the bold element. If 

In accordance with the preferred embodiment and the above examples, the 
HTML syntax errors identified above are resolved by noting any elements terminated by 
the start of the second paragraph and by creating child nodes (ie. special node with no 
direct mapping to HTML) in the second paragraph that are links back to the initial 
elements in the first paragraph. In the case of Code D, by the closing the first paragraph 
is explicit, and the preferred embodiment uses the unexpected termination of the bold 
element as an instruction to create a link back to the next suitable containing element. 

Fig. 1 illustrates the tree structure of the strict HTML of Code A discussed 
above. In Fig. 1, the body 102 is a root node of the expression tree forming the HTML 
document. The first paragraph 104 is depicted as a first child node and ft-om which the 
bold switch 106 depends, followed by the text of the first paragraph 108. Similarly, the 
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second paragraph is depicted as the second child 1 10 followed by its corresponding bold 
switch 112 and corresponding second paragraph text 114. In an HTML traversal of the 
tree 100, traversal commences at the root node 102 and then proceeds along a first branch 
to a first child 104. In order to progress to the terminal element of the first branch of the 

5 tree 100, one must pass through the bold switch 106 that operates on the text 108. In 
order to process the second branch, processing must reverse back along the first branch, 
switching off the bold 106 and terminating the first paragraph 104, before transiting the 
root node 102 to the second child node 110. 

In the erroneous representation of Code C, the corresponding tree is incomplete 

10 in that the text 108 moves back directly to the paragraph 104 without transiting the 
bold 106. Under a strict HTML interpretation, and implementing limited error correction, 
such would provide for the second paragraph to be displayed in plain type, and not bold. 
In this particular example, one solution afforded by the present invention lies fn 
recognizing the type of error in order to give the second bold switch 112 a link 120 bfeck 

15 to the first bold switch 106 in a form that provides for correct HTML interpretation. 

However, there is no standard HTML representation for such a Unk. An aUemativeis to 

♦ 

copy the desired structure fi-om the complementary parent node. 

The preferred embodiment addresses these issues by reconstructing the. tree 
structure of the HTML document as the document is linearly read. Specifically, in such a 

20 reconstruction, each tag in a node does something to the tree, for example to start a node 
or end a node. Each node is created as being a child of the previous node. Errors occur 
when nesting within paragraphs is incomplete. A solution is that, as one traverses 
through the tree, to create a new node and to remember what has been traversed so that 
one can then trace back through the tree to correct the remaining nodes. As a 

25 consequence of such an arrangement, as represented in Fig. 1, the erroneous HTML may 
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be corrected by creating an intuitive link 120 from the second bold switch 1 12 back to the 
first bold switch 106. 

A specific example of such a solution is shown in Figs. 2A to 2F in relation to 
the erroneous code of Code C depicted above. 
5 Fig. 2A shows the inception of the tree structure comprising a root node 200 

identified by the tag *'body". Associated with the root node 200 is the corresponding 
insertion point 202 indicating a location at which a child node is to depend. As seen from 
Fig. 2B, a first child node 204 relating to the first paragraph is appended to the root 
node 200 at the insertion point 202. A new insertion point 206 is arranged depending 

10 from the first child node. Fig. 2C follows in the similar fashion thereby the next node 208 
corresponding to the bold switch is appended to the first child node 204, and a new 
insertion point 210 created. 

Fig. 2D illustrates the inclusion of text 212 of the first paragraph and dependii^g 
from the insertion point 210. It is noted in this regard that in Fig, 2D, the inser|fon 

15 point 210 remains depending from the bold node 208 because, under the HTML standard, 
text cannot be conceived as a container of other tags (ie. additional nodes in the tree). In 
this regard, the text is the content of the document as opposed to something that marlcs-up 
the manner in which the content is presented. ^ 

The next step in the preferred embodiment is to attempt to add the second 

20 paragraph to the tree as depicted in Fig. 2D. If the second paragraph of Code C were to 
be added at the current insertion point 210, such would violate the HTML rule that 
paragraphs cannot be nested within each other. According to the preferred embodiment, 
the insertion point 210 is retracted back along the tree to a point where the new paragraph 
can be appended. Specifically, in tracking back, it is noted that the bold node 208 is to be 

25 recreated. The insertion point then passes to the paragraph 204. One paragraph cannot 
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depend from other, and thus paragraph 204 also requires recreation. Traversal then 
returns to the root node 200 where it is determined that a new paragraph may be appended 
thereto. The new instruction for the creation of the second paragraph is shown in Fig. 2E, 
with the creation of paragraph 214 appended to the root node 200. A new insertion 
5 point 216 is created. 

The next step in the processing is to recreate each of the elements that were 
passed in the first branch of the tree prior to the new instruction being added. The result 
is seen in Fig. 2F where, appended to the paragraph 214, is a bold element 218 
corresponding to the bold element 208 having been traversed in the first branch of the 

10 tree. The insertion point is updated to the point 222 at which text of the second 
paragraph 220 may be appended. 

In the preferred embodiment, it is important that the extra node link back to the 
original node, rather than simply being another node of the same type, for example copied 
from the original node. The reason for this is that it is possible for languages to associate 

15 information with nodes according to the structure of the HTML document, this being a 
more elegant and computationally flexible solution than the "brute-force" method of 
copying sections of code. In this regard. Code E below incorporates a component of 
CSS2 code that sets the colour of a bold element that is the child of a paragraph that is the 
first child of its parent. 

20 Code E 

<HEAD> 

<STYLE> } 
P:first-child B{color:red} } CSS2 code 

</STYLE> } 
25 <BODY> 

<P><B>The first paragraph, 
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<P>The second paragraph. 
</BODY> 

The purpose of Code E will be appreciated is to colour the paragraphs with the 

colour red. The commonly expected behaviour of such code, given that it is represented 

by incorrect HTML, is that the second paragraph would thus also be coloured red. If the 

structural correction of the preferred embodiment had been the equivalent of putting a 

fully independent bold element in the second paragraph, then that second bold element 

would not have matched the selector for the rule which applied the colour of red. The 

preferred method for implementing such presentation is to work forward through the 

original HTML source document constructing the expression tree as the traversal 

proceeds. A notion of the current insertion point into the tree is maintained as the tree is 

formed. The input of the tree is broken into two types of instructions, firstly those that 

create a new node (either because of the new element tag or text content, or secondly to 

end a node, because of the existence of closing tags. When a new element is attempted to 

be added to be added to the tree, the new element is tested to determine if it is of a type 

that is permitted to be nested at the current insertion point. If the new element is 

acceptable, then the new element is added to the tree and a new insertion point cremated 

unless the element is of a type that must always be a leaf node in the tree. If it is not 

# 

acceptable to add the new element at the current insertion point, the preferred 
embodiment works its way back through the parent nodes noting those parent nodes 
which are required to be recreated as link back nodes in the new node. If an acceptable 
parent node is identified, the new element node is created and the link back nodes are 
added to the new element node. If an ending tag is encountered, the tree is traversed back 
through the ancestors from the insertion point noting in order those nodes need to be 
linked back. This proceeds until an element is identified that requires termination. The 
parent of the terminated element then made to be the new insertion point to which the 
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new link back nodes are added. As each link back node is created, that node becomes an 
insertion point in its own right. Accordingly, if there are any multiple link back nodes, 
each would be created as a child of the previous link back in terms. 

Returning the CSS2 code indicated in Code E above, and the method steps 
depicted in Figs. 2A to 2F, two alternative arise for the appropriate processing of the 
CSS2 information. The first alternative is to do a first pass on the tree to obtain all CSS2 
information, being those which require the fetching of additional documents to get the 
CSS2 information. This information is retained in memory so that each time a node is 
placed, a check can be determined as to whether the CSS information applies and if so, it 
is then applied to the node. Such an alternative however will not work for dynamic 
HTML. A solution to this is a further alternative where, as in the step depicted by 
Fig. 2F, a vector is formed which links back between the second bold node 218 to the 
original bold node 208 from which it was created so that the CSS information can ^e 
copied from the original node but link being shown in Fig. 2F as the link 224. I 

The restructuring method of Figs. 2 A to 2F and generally described herein are 
preferably practiced using a conventional general-purpose computer system 300, sucjh as 
that shown in Fig. 3 wherein the restructuring processes are implemented as software, 
such as an application program executing within the computer system 30^0. In particular, 
the steps of the restructuring method are effected by instructions in the software that are 
carried out by the computer. The software may be divided into two separate parts; one 
part for carrying out the restructuring methods; and another part to manage the user 
interface between the latter and the user. The software may be stored in a computer 
readable medium, including the storage devices described below, for example. The 
software is loaded into the computer from the computer readable medium, and then 
executed by the computer. A computer readable medium having such software or 
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computer program recorded on it is a computer program product. The use of the 
computer program product in the computer preferably effects an advantageous apparatus 
for restructuring HTML documents in accordance with the embodiments of the invention. 

The computer system 300 comprises a computer module 301, input devices such 
as a keyboard 302 and mouse 303, output devices including a printer 315 and a display 
device 314. A Modulator-Demodulator (Modem) transceiver device 316 is used by the 
computer module 301 for communicating to and from a communications network 320, for 
example connectable via a telephone line 321 or other functional medium. The 
modem 316 can be used to obtain access to the Internet, and other network systems, such 
as a Local Area Network (LAN) or a Wide Area Network (WAN). 

The computer module 301 typically includes at least one processor unit 305, a 
memory unit 306, for example formed from semiconductor random access memory 
(RAM) and -read only memory (ROM), input/output (I/O) interfaces including a video 
interface 307, and an I/O interface 313 for the keyboard 302 and mouse 303 4nd 
optionally a joystick (not illustrated), and an interface 308 for the modem 316. A storage 
device 309 is provided and typically includes a hard disk drive 310 and a floppy 4isk 
drive 311. A magnetic tape drive (not illustrated) may also be used. A CD-ROM 
drive 312 is typically provided as a non- volatile source of data. The components 305 
to 313 of the computer module 301, typically communicate via an interconnected bus 304 
and in a manner which results in a conventional mode of operation of the computer 
system 300 known to those in the relevant art. Examples of computers on which the 
embodiments can be practised include IBM-PC's and compatibles. Sun Sparcstations or 
alike computer systems evolved therefrom. 

Typically, the application program of the preferred embodiment is resident on 
the hard disk drive 310 and read and controlled in its execution by the processor 305. 
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Intermediate storage of the program and any data fetched from the network 320 may be 
accomplished using the semiconductor memory 306, possibly in concert with the hard 
disk drive 310. Reconstruction of the tree according to the preferred embodiment may be 
performed in the memory 306. In some instances, the application program may be 

5 supplied to the user encoded on a CD-ROM or floppy disk and read via the corresponding 
drive 312 or 311, or altematively may be read by the user from the network 320 via the 
modem device 316. Still further, the software can also be loaded into the computer 
system 300 from other computer readable medium including magnetic tape, a ROM or 
integrated circuit, a magneto-optical disk, a radio or infra-red transmission channel 

10 between the computer module 301 and another device, a computer readable card such as a 
PCMCIA card, and the Internet and Intranets including e-mail transmissions and 
information recorded on Websites and the like. The foregoing is merely exemplary of 
relevant computer readable mediums. Other computer readable mediums may l?e 
practiced without departing from the scope and spirit of the invention. If 

15 The restructuring methods described above permit poorly formed HTML to be 

interpreted restructured into a syntax corresponding to the HTML standard. As a 
consequence, that restructured syntax may then be interpreted by a browsing application 
thereby enabling consistent reproduction according to the HTML standard. 

Although examples described above in relation to the preferred embodiment 

20 relate to text, paragraphs, and bold operators, similarly issues can arise through the 
interpretation of other switches, content, and the like which prevail the HTML standards. 
This may also include the provisional of italicised text, incorporation of images and the 
presentation and images in tables and the like. 

Industrial Applicability 
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It is apparent from the above that the embodiment(s) of the invention are 
appHcable to the computer and data processing industries, and in particular to computer 
network browsing software appHcations where the application may be exposed to a wide 
variety of documents, each purporting to coincide with a particular standard, but not 
necessarily conforming to that standard. 

The foregoing describes only one embodiment of the present invention, and 
modifications and/or changes can be made thereto without departing from the scope and 
spirit of the invention, the embodiment being illustrative and not restrictive. 

In the context of this specification, the word "comprising" means "including 
principally but not necessarily solely" or "having" or "including" and not "consisting only 
of. Variations of the word comprising, such as "comprise" and "comprises" have 
corresponding meanings. 
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The claims defining the inventicn are as fellows* 

1. A method of restructuring an input HTML document to comply with strict 
HTML, said method comprising the steps of: 

(a) linearly traversing said input HTML document to create a hierarchical 
tree structure representation, said traversal maintaining a current insertion point for 
elements within said tree structure representation; 

(b) during said traversal, identifying those elements of said input HTML 
document that violate strict HTML and, for each said identified element: 

(b)(i) retracing said tree structure representation from said current 
insertion point to identify an further insertion point from which said identified 
element can depend, said retracing comprising noting each parent element of said 
identified element passed during said retracing; f 

(b)(ii) at said further insertion point, creating new elements in laid 
tree structure representation corresponding to those said parent elements passed 
during said retracing, said new elements being created in reverse chronological 
order to that encountered during said retracing; and 

(b)(iii) appending said identified element to a terminal^one of said new 
elements; and 

(c) converting said tree structure representation into an output HTML 
document. 

2, A method according to claim 1, wherein step (b)(iii) comprises creating a link 
from said appended identified element to a first said parent element encountered during 
said retracting. 



487849 CFP1575AU Page+28 



iI:\ELriC\ClSRA\PAGEPLUSVPagc281487849.doc:ldp 



- 17 - 



3. A method according to claim 2 wherein said link comprises a vector, 

4. A method according to claim 1 wherein step (b)(iii) comprises copying a syntax 
5 of a first said parent element encountered during said retracting to said appended 

identified element. 

5. A method according to any one of claims 1 to 4, wherein one or more of said 
elements comprises information associated therewith, said method comprising the further 

10 steps, before step (a) of: 

performing an initial pass of said input HTML document to identify said 
elements having said associated information, and maintaining a record of each such 
element and the corresponding associated information whereby each time said element fs 
placed in said tree structure representation, the corresponding associated informatio^i is 

15 associated therewith. 

6. A method according to any one of the preceding claims comprising the fiarther 
step of: ^ 

(d) reproducing said output HTML document. 

20 

7. A method according to claim 6 wherein said output HTML document is 
reproduced using a video display. 

8. A method according to claim 6 wherein said output HTML document is 
25 reproduced using a printer. 
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9. A method of restructuring an input HTML document to comply with strict 
HTML substantially as described herein with reference to the drawings or any one of the 
examples. 

10. A printed document formed using the method of claim 8 or 9. 

1 1 . Apparatus for performing the method of any one of claims 1 to 9. 

12. A computer program element comprising computer program code means to 
make a computer execute a procedure to perform the method of any one of claims 1 to 9. 

13. A computer readable medium, having a program recorded thereon, where i]^ 
program is configured to make a computer execute a procedure to perform the method! of 
any one of claims 1 to 9. 

DATED this Twenty-second Day of December 1999 
CANON KABUSHIKI KAISHA ^ 

Patent Attorneys for the Applicant 
SPRUSON&FERGUSON 
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